Non-equivalence of stochastic optimal control problems with open and closed loop controls

نویسندگان

چکیده

For an optimal control problem of Itô’s type stochastic differential equation, the process could be taken in open-loop or closed-loop forms. In standard literature, provided appropriate regularity, value functions under these two types controls are equal and unique (viscosity) solution to corresponding (path-dependent) HJB equation. this short note, we provide a counterexample path dependent setting showing that can different general.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning open-loop from closed-loop control

This paper explores an evolution from closed-loop control to open-loop control for a planar manipula-tor. A reinforcement learning strategy is used to learn the open-loop commands from the closed-loop control. The goal is to produce a motion using purely open-loop control strategy, thereby eliminating the need for inter-link communication and on-line control computations. Initially closed loop ...

متن کامل

Mean-Field Stochastic Linear Quadratic Optimal Control Problems: Closed-Loop Solvability

An optimal control problem is studied for a linear mean-field stochastic differential equation with a quadratic cost functional. The coefficients and the weighting matrices in the cost functional are all assumed to be deterministic. Closed-loop strategies are introduced, which require to be independent of initial states; and such a nature makes it very useful and convenient in applications. In ...

متن کامل

Team-optimal closed-loop Stackelberg strategies in hierarchical control problems

This paper is concerned with the derivation of closed-loop Stackelberg (CLS) solutions of a class of continuous-time two-player nonzero-sum differential games characterized by linear state dynamics and quadratic cost functionals. Explicit conditions are obtained for both the finite and infinite horizon problems under which the CLS solution is a representation of the optimal feedback solution of...

متن کامل

Optimal control versus stochastic target problems: An equivalence result

Within a general abstract framework, we show that any optimal control problem in standard form can be translated into a stochastic target problem as defined in [17], whenever the underlying filtered probability space admits a suitable martingale representation property. This provides a unified way of treating these two classes of stochastic control problems. As an illustration, we show, within ...

متن کامل

Open-loop and Closed-loop Optimization of Linear Control Systems

A canonical optimal control problem for linear systems with timevarying coefficients is considered in the class of discrete controls. On the basis of linear programming methods, two primal and two dual methods of constructing optimal open-loop controls are proposed. A method of synthesis of optimal feedback control is described. Results are illustrated by a fourth-order problem; estimates of ef...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Systems & Control Letters

سال: 2021

ISSN: ['1872-7956', '0167-6911']

DOI: https://doi.org/10.1016/j.sysconle.2021.104948